
CLAIMS 

What is claimed is: 

1 . /fin apparatus for incorporating decision making into classifiers to provide efficient 
tes\ recommendations, the apparatus comprising: 

a. \an explicit system and a classifier each configured to receive a system state 

dataset, with the explicit system connected with the classifier, and operative to 
iteratively perform a combinatory search procedure based on the system state 
datasel to develop a next test recommendation for the classifier, whereby the 
classified performs the next test to generate an objective weighted score; 

b. a profit mddule connected with the classifier and with the explicit system to 
receive the Objective weighted score from the classifier, to add subjective 
value to the objective weighted score to determine a profit for the test, and to 
provide the profiAto the explicit system to enable the explicit system to assess 
the value of its next\est recommendation, and, iteratively, to generate a best 
test recommendation based on the maximization of the profit; 

25. an implicit system configured to receive a system state dataset, and connected 
with the explicit system to receive the best test recommendation for each 
system state dataset, and to actVs a function estimator to learn to associate 
best test recommendations with the system state dataset in order to mimic the 
explicit system, thereby to enable r\pid decision making in situations that are 
either urgent or well-known. \ 



Method and Apparatus for Incorporating Decision Making into Classifiers 

Bradley C. Love 
Page 31 of 38 



3/ 



2. Apparatus for incorporating decision making into classifiers to provide efficient 
test recommendations as set forth in claim 1, wherein the explicit system and the 
implicit system are configured to provide test recommendations to a controller. 

3. An apparatus for incorporating decision making into classifiers to provide efficient 
test recommendations as set forth in claim 1, wherein the implicit system is a neural 
network. \ 

4. An apparatus for incorporating decision making into classifiers to provide efficient 
test recommendationsVt set forth in claim 3, wherein the neural network is a radial 
basis neural network. \ 

5. An apparatus for incorporating decision making into classifiers to provide efficient 
test recommendations as set fotth in claim 3, wherein the combinatory search 
procedure performed by the explicit system is simulated annealing. 

6. An apparatus for incorporating decision making into classifiers to provide efficient 
test recommendations as set forth in cteim 5, wherein the explicit system and the 
profit module may be separated from tha apparatus after the implicit system 
sufficiently mimics the explicit system. \ 

7. An apparatus for incorporating decision making into classifiers to provide efficient 
test recommendations as set forth in claim 1, wherein the system state is a vector. 
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8. An\apparatus for incorporating decision making into classifiers to provide efficient 
test recommendations as set forth in claim 1, wherein the classifier is a probabilistic 
model. 

9. An apparatusVor incorporating decision making into classifiers to provide efficient 
test recommendations as set forth in claim 8, wherein the classifier is Bayesian. 
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10. A method for enhancing decision making in a classifier system, wherein the classifier 
system includes an explicit system and a classifier, each configured to receive a 
system state dataset, with the explicit system connected with the classifier; a profit 
module connected with the classifier and with the explicit system; and an implicit 
system configured to receive aWstem state dataset, and connected with the explicit 
system, the method comprising the steps of: 

a. receiving a system state datasef^in the explicit system, the classifier, and the 
implicit system; 

b. determining in the explicit systenA based on the feature set, a recommended test; 

c. performing the recommended test on the classifier; 

d. determining, via the profit module, th)^ profit from the test performed on the 
classifier; 

e. detecting whether the test performed on tfte classifier maximizes the profit; 

f. performing the receiving step a through the\letecting step e until a test is found 

which maximizes the profit; 
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graining the implicit system with the system state dataset and the test which 
maximizes the profit; and 

h. repeating steps a through g until a desired level of training of the implicit system 
is reached. 

1 1. A method for enhancing decision making in a classifier system as set forth in claim 
10, wherein the test that maximizes the profit is provided by either the explicit system 
or the implicit system to a controller. 

12. A method for enhancing decision making in a classifier system as set forth in claim 
10, wherein the implicit system used is a neural network. 

13. A method for enhancing decision making in a classifier system as set forth in claim 
12, wherein the implicit Wstem used is a radial basis neural network. 

14. A method for enhancing decision making in a classifier system as set forth in claim 
12, wherein the determining Wp b is performed by the explicit system using a 
combinatory search procedures 

15. A method for enhancing decisionmaking in a classifier system as set forth in claim 
14, wherein the combinatory search procedure performed by the explicit system in the 
determining step b is simulated annealing. 
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16. X method for enhancing decision making in a classifier system as set forth in claim 
15, Vherein the explicit system and the profit module used may be separated from the 
app after the implicit system sufficiently mimics the explicit system. 

17. A method rbr enhancing decision making into classifiers to provide efficient test 
recommendations as set forth in claim 10, wherein the system state is a vector. 

18. An method for enhancing decision making into classifiers to provide efficient test 
recommendations as set forth in claim 10, wherein the classifier is a probabilistic 
model. \ 

19. An method for enhancing decision making into classifiers to provide efficient test 
recommendations as set forth in claim 18, wherein the classifier is Bayesian. 

20. A method for enhancing decision making in classifiers to provide efficient test 
recommendations, the method comprising the steps of: 

a. providing an explicit system andV classifier each configured to receive a 
system state dataset, with the exploit system connected with the classifier, 
and operative to iteratively perform k combinatory search procedure based on 
the system state dataset to develop a neVt test recommendation for the 
classifier, whereby the classifier performsvthe next test to generate an 
objective weighted score; \ 
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b. providing a profit module connected with the classifier and with the explicit 
system to receive the objective weighted score from the classifier, to add 
subjective value to the objective weighted score to determine a profit for the 
test, and to provide the profit to the explicit system to enable the explicit 
system to assess the value of its next test recommendation, and, iteratively, to 
generate a\best test recommendation based on the maximization of the profit; 

c. providing an implicit system configured to receive a system state dataset, and 
connected with the explicit system to receive the best test recommendation for 
each system state dataset, and to act as a function estimator to learn to 
associate best test recommendations with the system state dataset in order to 
mimic the explicit system, thereby to enable rapid decision making in 
situations that are either urgent or well-known. 

21 . A method for enhancing decision making in a classifier system as set forth in claim 
20, wherein the explicit systemWd the implicit system are further configured to 
provide the test recommendatiomto a controller. 

22. A method for enhancing decision making in a classifier system as set forth in claim 
20, wherein the implicit system provided is a neural network. 



23. A method for enhancing decision making in a classifier system as set forth in claim 
22, wherein the implicit system provided\s a radial bias neural network. 
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24. A kiethod for enhancing decision making in a classifier system as set forth in claim 
22, wherein the explicit system provided performs the combinatory search procedure 
by use of simulated annealing. 

5 25. A method for enhancing decision making in a classifier system as set forth in claim 
24, wherein the explicit system provided and the profit module provided may be 
separated from\he classifier system provided after the implicit system sufficiently 
mimics the explicit system. 

j « \ 
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ig 10 26. A method for enhancing decision making into classifiers to provide efficient test 
u recommendations as sk forth in claim 20, wherein the system state is a vector. 

;!! 27. An method for enhancing decision making into classifiers to provide efficient test 

j 3 recommendations as set foVth in claim 20, wherein the classifier is a probabilistic 

q 15 model. \ 

28. A method for enhancing decision making into classifiers to provide efficient test 
recommendations as set forth in claim 27, wherein the classifier is Bayesian. 
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